General practitioners' evaluation of community psychiatric services: responsiveness to change of the General Practitioner Experiences Questionnaire (GPEQ)

<p>Abstract</p> <p>Background</p> <p>Instruments have been developed to assess professional views of the quality of care but have rarely been tested for responsiveness to change. The objective of this study was to test the responsiveness of the General Practitioner Experiences Questionnaire (GPEQ) for the measurement of Community Mental Health Centres in Norway.</p> <p>Methods</p> <p>National surveys were conducted in Norway in 2006 (n = 2,415) and 2008 (n = 2,209) to measure general practitioners' evaluation of community mental health centres. GPs evaluated the centres by means of a postal questionnaire, consisting of questions focused on centre quality and cooperation with GPs. As part of the national surveys 75 GPs in 2006 and 66 GPs in 2008 evaluated Hamar community mental health centre. Between the surveys, several quality improvement initiatives were implemented which were directed at cooperation with and guidance for GPs in Stange municipality, one of eight municipalities in Hamar centre catchment area. The main outcome measures were changes in GPEQ scores from 2006 to 2008 for GPs evaluating Hamar community mental health centre from Stange municipality, and changes in scores for GPs in the other seven municipalities and nationally which were assessed for statistical significance.</p> <p>Results</p> <p>GPs in Stange municipality rated Hamar community mental health centre significantly better on the guidance scale in 2008 than in 2006; on a 0-100 scale where 100 represents the best possible experiences the score was 26.5 in 2006 and 58.3 in 2008 (p < 0.001). Apart from one item about workforce situation, none of the other scales and items showed significant changes. The control group from the other seven municipalities gave significantly poorer rating for the emergency situation scale, the workforce situation scale and seven items in 2008 than in 2006. The national results showed small differences between 2006 and 2008, even though several scales and items were significantly different. A question about changes in centre performance over the last 2-3 years showed that 82% of GPs from Stange municipality reported that Hamar community mental health centre had improved, compared to only 36% from the other seven municipalities and 40% nationally which was statistically significant.</p> <p>Conclusions</p> <p>Following the implementation of an initiative designed to enhance service quality, the GPEQ identified expected changes in the guidance scale for the intervention group, indicating that the instrument is responsive to change. The worsening of services for GPs in the control group evaluating Hamar centre warrants further study.</p

The association between survey timing and patient-reported experiences with hospitals: results of a national postal survey

<p>Abstract</p> <p>Background</p> <p>Research on the effect of survey timing on patient-reported experiences and patient satisfaction with health services has produced contradictory results. The objective of this study was thus to assess the association between survey timing and patient-reported experiences with hospitals.</p> <p>Methods</p> <p>Secondary analyses of a national inpatient experience survey including 63 hospitals in the 5 health regions in Norway during the autumn of 2006. 10,912 (45%) patients answered a postal questionnaire after their discharge from hospital. Non-respondents were sent a reminder after 4 weeks. Multilevel linear regression analysis was used to assess the association between survey timing and patient-reported experiences, both bivariate analysis and multivariate analysis controlling for other predictors of patient experiences.</p> <p>Results</p> <p>Multivariate multilevel regression analysis revealed that survey time was significantly and negatively related to three of six patient-reported experience scales: doctor services (Beta = -0.424, <it>p</it>< 0.05), information about examinations (Beta = -0.566, <it>p </it>< 0.05) and organization (Beta = -0.528, <it>p </it>< 0.05). Patient age, self-perceived health and type of admission were significantly related to all patient-reported experience scales (better experiences with higher age, better health and routine admission), and all other predictors had at least one significant association with patient-reported experiences.</p> <p>Conclusions</p> <p>Survey time was significantly and negatively related to three of the six scales for patient-reported experiences with hospitals. Large differences in survey time across hospitals could be problematic for between-hospital comparisons, implying that survey time should be considered as a potential adjustment factor. More research is needed on this topic, including studies with other population groups, other data collection modes and a longer time span.</p

The association between demographic factors, user reported experiences and user satisfaction: results from three casualty clinics in Norway

<p>Abstract</p> <p>Background</p> <p>User reported experiences and satisfaction are increasingly used as basis for quality indicators in the health sector. However, there is limited understanding of factors associated with user reported experiences and satisfaction with casualty clinics.</p> <p>Methods</p> <p>A random sample of 542 patients that had contacted any of three casualty clinics from mid April to mid May 2008 was mailed a questionnaire. A reminder was sent to non-respondents after six weeks. Descriptive statistics for four user reported experiences scales and 20 single items are presented. Multivariate regression analysis was used to assess associations between background variables and user reported experiences, and between user reported experiences and user satisfaction.</p> <p>Results</p> <p>225 (41.5%) patients, carers and guardians returned a completed questionnaire. Users reported most positive experiences with the doctor services and the nursing services at the casualty clinics; on a scale from 0 to 100, where 100 is the best possible experience the doctor scale was 82 and the nursing scale 81. Users reported least positive experiences with the organization of the casualty clinic, with a scale score of 65. Self perceived health was associated with user satisfaction, while self perceived health and age were associated with user reported experiences with organization of the clinics. A range of user reported experience domains were related to user satisfaction, after controlling for socio-demographic variables, including experiences with doctor services at the clinics, organization of the clinics, information and self perceived incorrect treatment.</p> <p>Conclusions</p> <p>Users report positive experiences with the three casualty clinics, with organization as the aspect with largest improvement potential. The importance of age and health status for users' experiences and satisfaction with casualty clinics was shown, but a range of user reported experiences with the clinics were the most important predictors for user satisfaction.</p

The Generic Short Patient Experiences Questionnaire (GS-PEQ): identification of core items from a survey in Norway

<p>Abstract</p> <p>Background</p> <p>Questionnaires are commonly used to collect patient, or user, experiences with health care encounters; however, their adaption to specific target groups limits comparison between groups. We present the construction of a generic questionnaire (maximum of ten questions) for user evaluation across a range of health care services.</p> <p>Methods</p> <p>Based on previous testing of six group-specific questionnaires, we first constructed a generic questionnaire with 23 items related to user experiences. All questions included a "not applicable" response option, as well as a follow-up question about the item's importance. Nine user groups from one health trust were surveyed. Seven groups received questionnaires by mail and two by personal distribution. Selection of core questions was based on three criteria: applicability (proportion "not applicable"), importance (mean scores on follow-up questions), and comprehensiveness (content coverage, maximum two items per dimension).</p> <p>Results</p> <p>1324 questionnaires were returned providing subsample sizes ranging from 52 to 323. Ten questions were excluded because the proportion of "not applicable" responses exceeded 20% in at least one user group. The number of remaining items was reduced to ten by applying the two other criteria. The final short questionnaire included items on outcome (2), clinician services (2), user involvement (2), incorrect treatment (1), information (1), organisation (1), and accessibility (1).</p> <p>Conclusion</p> <p>The Generic Short Patient Experiences Questionnaire (GS-PEQ) is a short, generic set of questions on user experiences with specialist health care that covers important topics for a range of groups. It can be used alone or with other instruments in quality assessment or in research. The psychometric properties and the relevance of the GS-PEQ in other health care settings and countries need further evaluation.</p

Rasch analysis of the Psychiatric Out-Patient Experiences Questionnaire (POPEQ)

<p>Abstract</p> <p>Background</p> <p>The Psychiatric Out-Patient Experiences Questionnaire (POPEQ) is an 11-item core measure of psychiatric out-patients experiences of the perceived outcome of the treatment, the quality of interaction with the clinician, and the quality of information provision. The POPEQ was found to have evidence for reliability and validity following the application of classical test theory but has not previously been assessed by Rasch analysis.</p> <p>Methods</p> <p>Two national postal surveys of psychiatric outpatients took place in Norway in 2004 and 2007. The performance of the POPEQ, including item functioning and differential item functioning, was assessed by Rasch analysis. Principal component analysis of item residuals was used to assess the presence of subdimensions.</p> <p>Results</p> <p>6,677 (43.3%) and 11,085 (35.2%) psychiatric out patients responded to the questionnaire in 2004 and 2007, respectively. All items in the scale were retained after the Rasch analysis. The resulting scale had reasonably good fit to the Rasch model. The items performed the same for the two survey years and there was no differential item functioning relating to patient characteristics. Principal component analysis of the residuals confirmed that the measure to a high degree is unidimensional. However, the data also reflects three potential subscales, each relating to one of the three included aspects of health care.</p> <p>Conclusions</p> <p>The POPEQ had excellent psychometric properties and Rasch analysis further supported the construct validity of the scale by also identifying the three subdimensions originally included as components in the instrument development. The 11-item instrument is recommended in future research on psychiatric out-patient experiences. Future development may lead to the construction of more precise measures of the three subdomains that the POPEQ is based on.</p

International health policy survey in 11 countries: assessment of non-response bias in the Norwegian sample

Abstract Background International health policy surveys are used to compare and evaluate health system performance, but little is known about the effects of non-response. The objective of this study was to assess the effects of non-response in the Norwegian part of the Commonwealth Fund international health policy survey in 2009. Methods As part of an international health policy survey in 2009 a cross-sectional survey was conducted in Norway among a representative sample of Norwegian general practitioners. 1 400 randomly selected GPs were sent a postal questionnaire including questions about the Norwegian health care system, the quality of the GPs' own practice and the cooperation with specialist health care. The survey included three postal reminders and a telephone follow-up of postal non-respondents. The main outcome measures were increase in response rate for each reminder, the effects of demographic and practice variables on response, the effects of non-response on survey estimates, and the cost-effectiveness of each reminder. Results After three postal reminders and one telephone follow-up, the response rate was 59.1%. Statistically significant differences between respondents and non-respondents were found for three variables; group vs. solo practice (p = 0.01), being a specialist or not (p Conclusions The response rate in the Norwegian survey was satisfactory, and the effect of non-response was small indicating adequate representativeness. The cost-effectiveness of the final reminders was poor. The Norwegian findings strengthen the international project, but restrictions in generalizability warrant further study in other countries.</p